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Epitome 

(57) [Abstract] 

[Technical problem] The dead angle information is indicated by the automatic according to a 
condition by the image which does not have sense of incongruity to an operator s field of view, and 
operation is supported. 

[Means for Solution] Operation exchange equipment is equipped with the input unit 2 of various 
information containing image pick-up equipment 21, the control unit 1 which processes an 
incorporation image of image pick-up equipment, and the monitor 5 which displays a processing 
image. A control unit is connected with the navigation equipment 6 which can transmit a traffic 
information, judges the situation of approach in a crossing without a signal, an intention of lane 
modification, and the Nighttime rainfall transit based on a traffic information from navigation 
equipment, and information from the input unit 2 of various information, and displays automatically 
an incorporation image of information on the optimal road for exchange of each **** on a monitor 
based on this decision. 
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CLAIMS 



[Claim(s)] 

[Claim 1] Two or more image pick-up equipments which are installed in vehicles and incorporate 
information on the external world A control unit which processes an image which this image pick-up 
equipment captures A monitor which displays an image processed by this control unit It is operation 
exchange equipment equipped with the above, and said control unit is characterized by to connect 
with navigation equipment which can transmit a traffic information, to judge approach in a crossing 
without a signal based on a traffic information from this navigation equipment, and to have an image 
selection means display an incorporation image of information on a crossing road on a monitor 
automatically, based on this decision. 

[Claim 2] It is operation exchange equipment according to claim 1 which judges approach in a 
crossing where said control unit does not have said signal based on information on a transit 
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condition of vehicles inputted from an input unit, and the contents of operation in addition to a 
traffic information from said navigation equipment by having an input unit which inputs a transit 
condition and the contents of operation of vehicles into said control unit as information. 
[Claim 3] Information on a transit condition of said vehicles is operation exchange equipment 
according to claim 2 which is the low vehicle speed information by speed sensor included by input 
unit. 

[Claim 4] Information on said contents of operation is operation exchange equipment according to 
claim 2 which is the brakes operation information by brake sensor included by input unit. 
[Claim 5] Said control unit is operation exchange equipment [ equipped with an index display means 
to generate and incorporate an index supplementary to a traffic information of an incorporation 
image, and to superimpose in an image ] according to claim 2, 3, or 4. 

[Claim 6] Said index is operation exchange equipment according to claim 5 which is the graduation 
of standard distance on the ground from a self-vehicle. 

[Claim 7] Said graduation is operation exchange equipment according to claim 6 generated by 
processing based on a traffic information from navigation equipment according to the direction of a 
road where it crosses on an incorporation image. 

[Claim 8] Two or more image pick-up equipments which are installed in vehicles and incorporate 
information on the external world A monitor which displays a control unit which processes an image 
which this image pick-up equipment captures, and an image processed by this control unit It is 
operation exchange equipment equipped with the above, and has an input unit which inputs a transit 
condition and the contents of operation of vehicles into said control unit as information. Said control 
unit It connects with navigation equipment which can transmit a traffic information, and based on a 
traffic information from this navigation equipment, the number of the slow lanes is plurality and it is 
contingent [ on formation of decision of not approaching a crossing ]. Empty vehicle line 
modification is judged, either of the actions of vehicles obtained by transit condition of vehicles 
inputted from an input unit, information on the contents of operation, and image processing of a 
control unit — It is characterized by having an image selection means to display an incorporation 
image of information on vehicles back on a monitor automatically, based on decision of this lane 
modification. 

[Claim 9] Information on a transit condition of said vehicles and the contents of operation is 
operation exchange equipment according to claim 8 which is high vehicle speed information and 
actuation information on a winker switch by speed sensor included by input unit. 
[Claim 10] An action of said vehicles is operation exchange equipment according to claim 8 judged 
based on migration of an object recognized on an image. 

[Claim 11] Two or more image pick-up equipments which are installed in vehicles and incorporate 
information on the external world A control unit which processes an image which this image pick-up 
equipment captures A monitor which displays an image processed by this control unit it be 
operation exchange equipment equipped with the above , and it have the input unit which input a 
transit condition and the contents of operation of a vehicles into said control unit as information , 
said control unit judge a condition with a difficult check by looking of a self-vehicle location on a 
road based on the contents of operation from an input unit , and it be characterize based on this 
decision by have an image selection means display an incorporation image of information on the 
vehicles side on a monitor automatically . 

[Claim 12] Said contents of operation are operation exchange equipment according to claim 10 

which is the lighting information by actuation of a lamplight switch included by input unit. 

[Claim 13] Said contents of operation are operation exchange equipment according to claim 11 or 12 

which is the wiper actuation information by actuation of a windshield wiper switch included by input 

unit. 

[Claim 14] Said control unit is operation exchange equipment according to claim 1 1, 12, or 13 which 
includes an image-processing means to make an object on an incorporation image conspicuous. 
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[Claim 15] Said control unit is operation exchange equipment of claim 11-14 given in any 1 term 
which judges an action of vehicles based on migration of an object recognized on an image, and 
includes a warning means to superimpose warning information. 
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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[The technical field to which invention belongs] This invention incorporates the information on the 
vehicles circumference used as an operators dead angle with two or more image pick-up 
equipments, makes automatic selection of the required image according to a transit condition out of 
an incorporation image, expresses it as a vehicle indoor monitor, and relates to the exchange 
equipment which complements an operator s field of view. 
[0002] 

[Description of the Prior Art] Since an automobile has the body surrounding an operator's 
neighborhood, it produces the dead angle portion in which an operator s field of view is interrupted 
by Body Manufacturing Division except a window part. Moreover, the indirect dead angle portion 
which has a field of view interrupted by them is also produced from the physical relationship of 
surrounding geographical feature, a building, etc. also in the field of view which is not interrupted by 
the body. The dissolution of such a dead angle is a very important technical problem on reservation 
of safety. Then, a pure optics-means is used from the former and various dead angle dissolution 
means by which it was used are also further proposed with high-performance-izing and a 
miniaturization of the latest visual equipment so that the information on such a dead angle portion 
may be acquired indirectly. The technology of an indication is one of those which are considered to 
be effective when acquiring much information which covers the dead angle range of the vehicles 
circumference especially in such a proposal at JP,5-310078,A. This conventional technology 
compounds the 1st and 2nd cameras which photo the right-and-left both sides of vehicles back, the 
3rd and 4th cameras which photo the right-and-left both sides ahead of vehicles, and the image 
information obtained from them, and displays it on each of the display screen divided into four fields 
as an image. 
[0003] 

[Problem(s) to be Solved by the Invention] By the way, it cannot necessarily be said to be an 
effective method like the technology of the above-mentioned proposal as the transfer technique of 
the information to the operator under a short-sleeved shirt condition to provide an operator with 
much information in parallel. But with this technology, although required information can be narrowed 
down now by choosing one from the 1st thru/or the 4th image information, and making it display on 
the whole display screen, the operator himself has to perform that narrowing down and the thinking 
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for it is required of an operator. 

[0004] A possibility of it becoming rather troublesome it not being necessarily useful to exchange of 
operation there being much the information when providing an operator with dead angle information 
generally, and requiring thinking of informational selection, and useful information sometimes being 
overlooked, or it being avoided from the complicatedness of actuation, and no longer being used 
becomes high. Moreover, when the information is the information which requires urgency, it is also 
** to force the selection upon an operator. Therefore, the information for operation exchange is 
selected carefully by what is suitable and indispensable according to a condition on that occasion, 
and usefulness becomes [ the direction moreover obtained without the actuation according to rank ] 
high far. 

[0005] This invention sets it as the main purpose to offer the operation exchange equipment which 
can select carefully the image which can acquire the suitable information which agreed at the place 
which an operator means according to a condition among the information images of the image pick- 
up equipment which incorporates the vehicles circumference which is made in view of such a 
situation and serves as an operator's dead angle, and can carry out a value monitor automatically. 
[0006] 

[Means for Solving the Problem] Two or more image pick-up equipments which this invention is 
installed in vehicles and incorporate information on the external world in order to attain the above- 
mentioned purpose, In operation exchange equipment equipped with a control unit which processes 
an image which this image pick-up equipment captures, and a monitor which displays an image 
processed by this control unit said control unit Connect with navigation equipment which can 
transmit a traffic information, and approach in a crossing without a signal is judged based on a traffic 
information from this navigation equipment. It is characterized by having an image selection means 
to display an incorporation image of information on a crossing road on a monitor automatically, 
based on this decision. 

[0007] Furthermore, in order to raise decision accuracy for an automatic display, it has an input unit 
which inputs a transit condition and the contents of operation of vehicles into said control unit as 
information, and, as for said control unit, it is effective to consider as a configuration which judges 
approach in a crossing which does not have said signal based on information on a transit condition 
of vehicles which are inputted from an input unit in addition to a traffic information from said 
navigation equipment, and the contents of operation. 

[0008] And as for information on a transit condition of said vehicles, specifically, it is effective to 

consider as low vehicle speed information by speed sensor included by input unit. 

[0009] Moreover, as for information on said contents of operation, specifically, it is effective to 

consider as brakes operation information by brake sensor included by input unit. 

[0010] Moreover, in order to raise the usefulness of image information displayed, as for said control 

unit, it is also effective to consider as a configuration equipped with an index display means to 

generate and incorporate an index supplementary to a traffic information of an incorporation image, 

and to superimpose in an image. 

[001 1] As for said index, specifically, it is effective to consider as a graduation of standard distance 
on the ground from a self-vehicle. 

[0012] Furthermore, as for said graduation, it is effective to be generated by processing based on a 
traffic information from navigation equipment according to the direction of a road where it crosses 
on an incorporation image. 

[0013] Next, this invention is installed in vehicles and set to operation exchange equipment equipped 
with two or more image pick-up equipments which incorporate information on the external world, a 
control unit which processes an image which this image pick-up equipment captures, and a monitor 
which displays an image processed by this control unit It has an input unit which inputs a transit 
condition and the contents of operation of vehicles into said control unit as information. Said control 
unit It connects with navigation equipment which can transmit a traffic information, and based on a 
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traffic information from this navigation equipment, the number of the slow lanes is plurality and it is 
contingent [ on formation of decision of not approaching a crossing ]. Empty vehicle line 
modification is judged, either of the actions of vehicles obtained by transit condition of vehicles 
inputted from an input unit, information on the contents of operation, and image processing of a 
control unit — [0014] characterized by having an image selection means to display an incorporation 
image of information on vehicles back on a monitor automatically, based on decision of this lane 
modification In this case, as for information on a transit condition of said vehicles, and the contents 
of operation, specifically, it is effective to carry out [ of high vehicle speed information by speed 
sensor included by input unit and a winker switch ] actuation information. 

[0015] Moreover, as for an action of said vehicles, it is effective to be judged based on migration of 
an object recognized on an image. 

[0016] Next, this invention is installed in vehicles and set to operation exchange equipment equipped 
with two or more image pick-up equipments which incorporate information on the external world, a 
control unit which processes an image which this image pick-up equipment captures, and a monitor 
which displays an image processed by this control unit. It has an input unit which inputs a transit 
condition and the contents of operation of vehicles into said control unit as information. Said control 
unit Based on the contents of operation from an input unit, a check by looking of a self^-vehicle 
location on a road judges a difficult condition, and is characterized by having an image selection 
means to display an incorporation image of information on the vehicles side on a monitor 
automatically based on this decision. 

[0017] In this case, as for said contents of operation, it is effective to consider as lighting 
information by actuation of a lamplight switch included by input unit. 

[0018] Moreover, as for said contents of operation, it is also effective to consider as wiper actuation 
information by actuation of a windshield wiper switch included by input unit. 
[0019] Furthermore, as for said control unit, it is also effective to include an image-processing 
means to make an object on an incorporation image conspicuous. 

[0020] Furthermore, as for said control unit, it is also effective to include a warning means to judge 
an action of vehicles based on migration of an object recognized on an image, and to superimpose 
warning information. 
[0021] 

[Function and Effect of the Invention] Effective operation exchange can be offered with the 
configuration of the claim 1 above-mentioned publication, without giving an operator a burden and 
troublesomeness, since the dead angle information on the crossing road that an operator craves 
acquisition most can be displayed with automatically and sufficient timing at a crossing without a 
signal [ need / to be checked / the safety by grasp of the traffic condition of the crossing road / 
still ] as compared with a crossing with a signal. And since the existence of a signal has abolished 
the necessity of registering the data base of the crossing information on a proper into operation 
exchange equipment, as information for an automatic display using the information on the navigation 
equipment registered beforehand, the configuration of equipment can be simplified. 
[0022] Furthermore, with a configuration according to claim 2, need decision of the display which 
narrowed down the condition which an operator needs for it truly since the transit condition of 
vehicles and the information on operation which an operator s intention reflects are added to the 
decision for an automatic display comes to be made, and a troublesome information noise can be 
lost for an operator. 

[0023] And with a configuration according to claim 3, since the going-slowly condition as reflection 
of approach in the badness and the crossing of a prospect is used as the concrete decision element 
of the transit condition of vehicles, need decision of a display is narrowed down further and, 
moreover, a display stage is also fitness-ized. 

[0024] Moreover, with a configuration according to claim 4, since brakes operation as reflection of 
approach in the badness and the crossing of a prospect is used as the concrete decision element of 
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operation, need decision of a display is narrowed down further and a display stage is also further 
fitnessHzed along with desire of an operator. 

[0025] Furthermore, with a configuration according to claim 5, it can supplement with the image 
information which cannot deny that it is hard to judge the situation compared with direct viewing 
with the index which is easy to grasp intuitively, and a judgment of the road condition from a monitor 
image can be made easy. 

[0026] Furthermore, with a configuration according to claim 6, it can supplement with the difficult 
sense of distance of grasp especially by distortion of a monitor image, and the road situation from 
an image can be judged still easier. 

[0027] Furthermore, an index display can be made to generate appropriately with a configuration 
according to claim 7 according to a road condition. 

[0028] Next, with a configuration according to claim 8, effective operation exchange can be offered 
in lane modification under road transit of two or more lanes, without giving an operator a burden and 
troublesomeness, since the dead angle information on traffic of the self-vehicles back that an 
operator craves acquisition most can be displayed with automatically and sufficient timing. And as 
information for an automatic display, the number of the slow lanes is plurality, and since the 
necessity of registering the data base of the traffic information of a proper into operation exchange 
equipment is abolished using the information on navigation equipment that the number of lanes and 
the intersectional location are beforehand registered in decision of not approaching a crossing, the 
configuration of equipment can be simplified. 

[0029] Furthermore, with a configuration according to claim 9, since the high vehicle speed 
information and the actuation information on a winker switch by the speed sensor as reflection of 
the intention of lane modification are used as the concrete decision element, need decision of a 
display is narrowed down further and, moreover, a display stage is also rationalized. 
[0030] Furthermore, with a configuration according to claim 10, even when an operator does not 
operate a winker switch, information required for lane modification can be offered at a proper stage. 
[0031] With a configuration according to claim 1 1, according to next, the traffic conditions and 
meteorological conditions at the time of dazzling by reflection of the headlight of the oncoming car 
at the time of the Nighttime rainfall, generating of the fog in day ranges, and a heavy rain, such as a 
poor field of view Even when it is difficult to judge the check of the location of the self-vehicle to a 
transit lane or the road shoulder using the white line which shows the rain partition and the center 
line on a road It is not influenced of reflective because the sense of an optical axis differs to an 
operators look. Or a counterpart and an operator can be provided with the image information for 
recognizing a self-vehicle location [ as opposed to a transit lane top or the center line for the white 
line of self^vehicle nearness ] on a monitor using the incorporation image from the image pick-up 
equipment which cannot be easily influenced of a meteorological condition due to a thing near in 
location. 

[0032] And with a configuration according to claim 1 2 or 1 3, decision of the self-vehicle location by 
the direct-vision private seal of a white line can judge a difficult condition simply with the existing 
input unit on vehicles. 

[0033] Furthermore, even if an image top can be recognized, it can make it possible to recognize 
easily objects, such as a difficult white line of the check by looking for an operator on a monitor, 
with a configuration according to claim 14. 

[0034] Furthermore, with a configuration according to claim 15, the check of a self-vehicle location 
can offer a more positive thing operation exchange under the condition of a difficult poor field of 
view. 
[0035] 

[Embodiment of the Invention] Hereafter, the operation gestalt of this invention is explained along 
with a drawing. The outline of the operation exchange equipment which applied the thought of this 
invention is shown in drawing 2 and drawing 3 . It consists of an input unit 2 which incorporates 
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various information required for control, and a selecting switch 3 which choose suitably the 
information which an operator needs for operation by making into a subject the control unit 1 which 
contains the program to which this equipment processes an image for a system configuration in 
drawing 2 as a block shows, and it is further connected with Nabih ECU 6 possessing a data base 4 
and a display 5 of navigation equipment so that information interchange with navigation equipment is 
possible. This uses the display 5 for the monitor for the information display of this equipment with 
this gestalt. In addition, about the selecting switch 3 in drawing, although the thing of dedication may 
be prepared in this equipment, it is good also as the touch panel method using the display 5 of 
navigation equipment, or a voice input method using a voice recognition unit. Moreover, about a 
monitor, the thing of dedication may be prepared separately and it can also consider as a turning- 
the-head-up display method in that case. 

[0036] CCD camera 21 (when writing it as a camera and distinguishing each camera hereafter) 
shown in drawing by O mark as image pick-up equipment which constitutes one of the input units as 
arrangement is shown in draw[ngJ3 The cable addresses CF L, CF R, and CR L with a subscript and 
CR R which replace with a sign and express a location, CM L, and CM R Give. The obstruction 
detection sensor 28 (similarly) as distance detection equipment which it is installed in the center of 
four corners of vehicles, and right-and-left both sides, and is shown by ** mark cable addresses SF 
L, SF R, and SR L, SR R, SM L, SM R, SF M, and SR M giving — it is installed near [ the / same ] 
the location as a camera 21, and also is installed also in the center of an order edge. These distance 
detection equipment 28 can also make it to consider as the known equipment which carries out 
direct detection of the distance of a supersonic sensor, a laser, a millimeter wave radar, etc., etc. an 
operation means to find distance indirectly, by carrying out the image processing of the 
incorporation image of two or more above-mentioned cameras 21 within a control unit 1. 
[0037] As a premise which offers operation exchange concerning the theme of this invention, when 
performing various actuation on operation, it is important requirements to provide so that an 
operator may make required image information in agreement with the field-of-view sensation in the 
condition of sitting on the drivers seat, therefore, the way a camera 21 should cling about image 
pick-up equipment in order to realize it, in more detail, an installation posture and an installation 
location are devised and the device is added to the method of presentation and display timing of an 
image about the control unit. About these points, sequential explanation is first given from the 
installation posture of a camera 21. 

[0038] (Installation posture of image pick-up equipment) The dead angle range which does not look 
physical from the operator who sat on the driver s seat as shown in drawing 1 is point DF L, DF R, 
DR R, and DR L It becomes the range which gave the slash to drawing surrounded. However, the 
portion which is not visible with the pillar supporting the window frame or roof of a door is omitting 
illustration. In order to make in agreement with an operators sensation the image information which 
covers this range that is not visible and is moreover obtained, as the 1st device of an installation 
posture on the other hand, each camera 21 It is based on the posture which turned the bottom on 
the incorporation image ahead of vehicles, and turned the optical axis to the perpendicular lower 
part. According to front and rear, right and left of an arrangement location to vehicles, an inclination 
is attached in the direction of front and rear, right and left to the posture of criteria, and it installs 
at the edge of vehicles, i.e., the posture in which a left right-hand side edge is copied [ order ] about 
the edge of order, and right and left, at least. 

[0039] In accordance with this meaning, about each camera 21 installed in a vehicles corner, it 
installs so that it may become in the corner of the seHH>ody as a edge of the vehicles 
corresponding to that installation location, the vehicles circumference including that near, and the 
direction that looks down at the method of infinite distance to coincidence. About the corner of 
these vehicles, it especially sets in the latest passenger car etc. Although it is not necessarily 
ascertained since the radius of circle is given from the device on a design, with the corner of the 
vehicles told to this invention The near including the edge, i.e., outermost edge, when seeing self- 
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vehicles at a plane is meant. More specifically When using as a bumper the range which becomes 
the configuration which can guess the direction where the front end and the side edge or the back 
end, and the side edge of vehicles extend, for example, a corner, because the radius of circle of the 
angle of a bumper becomes small to the curvature almost near a straight line the front end and the 
side edge or the back end, and the side edge of a direction to vehicles to which the first transition 
of a bumper and a side edge or a trailing edge, and a side edge extend — which — it does not pass 
— the range which can guess whether it becomes a thing location is said. Therefore, they are the 
examples PF L, PF R, and PR L of an image of the camera of each corner, and PR R to d rawi ng 4 . 
They are each cameras CF L, CF R, and CR L and CR R so that it may be shown and may contain in 
an image to the range which becomes the configuration which can guess extension a body order 
edge and at the right end of the left respectively. A posture is set up. drawing — setting — a cable 
address WL L — WL R The white line of a road surface, W'L L, and W'L R The white line on an 
image and sign 90' show the bumper as a self-vehicle corner on an image. In this case, although the 
fitting location of a camera 21 is explained in full detail behind, generally, in each necessity part of 
the body, it installs in the highest possible place and a large field of view is secured. 
[0040] As the 2nd device of an installation posture, the horizontal sense of a camera 21 The 
direction of a look as shown in drawing 1 , in case an operator sits on a drivers seat and looks at 
the direction of necessity, and a direction which carries out outline coincidence, That is, the point 
that it is installed in the posture in which an optical axis X turns to the direction of the vertical 
plane containing the straight line which connects a camera 21 to an operator, and the same 
direction as a parenchyma top, and an optical axis X crosses the ground at relation with the posture 
by said 1st device is Points AF L, AF R, and AR L and AR R all over drawing. It becomes. Thereby, 
they are alphaF L, alphaF R, and alphaR L about alphaF, alphaR, and a lateral field angle range in the 
field angle range of the vertical direction which each camera 21 covers, alphaR R It is shown. In 
addition, the straight line which connects a camera 21 to the above-mentioned operator Although 
the sense will be changed in connection with them and the sense of the vertical plane containing the 
above-mentioned straight line will also be strictly changed since the slide position of a sheet and 
the inclination of a reclining change with an operator s physiques and favorite postures and it 
changes also with change of the posture of each **** further The direction of the above-mentioned 
vertical plane, and the same direction as a parenchyma top What is necessary is to deduce 
statistically the standard location which considered all such elements that what is necessary is just 
this direction in the range which permits a gap of such an operators location, and a gap of the 
direction accompanying change of a posture, to be the technique of determining an operator's 
location and just to set up a direction according to it. 

[0041] and having installed so that the horizontal axis on the image of a camera 21 might become 
level as it is — if — drawing 4 — referring to — bumper corner 90' of a self-vehicle — for example, 
camera CF L ******** — it will be located in the central lower part of a screen, and the white line 
WL L of the road surface which is concurrent with self-vehicles will become the image which 
crosses a screen in the shape of the diagonal line in the direction of the upper right (or upper left) 
from the lower left (or lower right). Then, a camera 21 is further installed in the posture which gave 
the inclination to the circumference of an optical axis X as the 3rd device of an installation posture. 
For example, about a left-hand side camera, a right-handed-rotation inclination is attached by 
twisting to the circumference of an optical axis on the right to vehicles. Thereby, a screen serves as 
sense whose sensation of an operator the advance direction suits as shown in drawing 4 . 
Specifically, it is Image PF L Camera CF L of installation in the left ventral horn section It is an 
image, left ventral horn section 90' is copied in a lower right corner, and it is white line W'L L of the 
shape of a straight line to the advance direction. It is reflected in general in the direction of the 
diagonal right in a straight line from a middle-of-the-screen lower part, and is actually the left-hand 
side white line WL L of a self-vehicle from a driver's seat. Feelings come to suit the angle and depth 
perception when seeing. Furthermore, if it says, this image will be the image PF L of for example, the 
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front left. Image PF R of the front right When it has arranged to right and left of a screen at 
coincidence, it is the image PF L at that time. Upper self-lane left-hand side white line W'L L Image 
PF R Upper self-lane right-hand side white line W'L R It is the arrangement which seems to cross 
depending on the method of infinite distance like [ when photoing the front with one camera ]. Thus, 
the inclination given to a screen is the same also about right-hand side and back right and left. 
[0042] (Installation location of image pick-up equipment) Next, it is the camera CFL to the left 
ventral horn section to drawing 5 and draw ing 6 about the installation location of image pick-up 
equipment. The example of anchoring is shown and it explains to details. At this example, it is 
Camera CF L As shown in drawing, it has a headlight 91 and composition included in the really 
constituted side lamp 92, and installation is made cheaply possible by the slight alteration according 
to this structure also at the existing vehicles. It is also possible to make a lamp small with a natural 
thing, to include in shell plates other than a lamp, or to attach to the body surface direct picking. 
[ including in the surplus space ] this — above — camera CF L the selM>ody left ventral horn 
section outermost edge [ directly under ] (drawing lefthand corner section of a before bumper) 90 
simultaneously the vehicles circumference, and the method of infinite distance are incorporated, 
although it divides and comes out Although it changes also with types of a car in order to 
incorporate the largest possible range so that the above-mentioned terms and conditions may be 
satisfied field angle alphaF of the vertical direction ******** — in general — about 90 degrees to it 
— some — large — field angle alphaF L of a longitudinal direction ******** — camera CF L of the 
wide angle lens which works on it size a little from about 90 degrees in general, and can secure a 
degree It is needed. However, if a field angle is made large not much, since the gap with the sense of 
distance of the substance which an operator looks at will become large, there is a limit naturally. 
Therefore, at this operation gestalt, it is field angle alphaF of the vertical direction as an example. 97 
degrees and field angle alphaF L of a longitudinal direction Camera CF L made into 125 degrees It is 
used. 

[0043] an installation posture [ thus ] and an installation location — natural image profit ****. It is 
the camera CF L of the before [ a self-vehicle ] lefthand corner section to drawing 7 . Image PF L 
The example of details is shown. White line WL L of the travelling direction drawn on the road 
surface by a diagram White line WL C which intersects perpendicularly with it How the image at the 
time of doubling the left ventral horn section of a self-vehicle with the perpendicular upper part of 
an intersection appears is expressed. In this screen, it is right-hand side white line W'L R of the 
travelling direction of a self-vehicle on the basis of bumper corner 90' of a self-vehicle. The 
included self-vehicle slow lane L'1, the lane L'2 on the left, and white line W'L C which intersects 
perpendicularly further It is possible to overlook the large range to the left lateral and to copy the 
method of infinite distance (for a dashed line to show to drawing) to the whole right-and-left width 
of face of a screen. And the method of infinite distance on extension of the transverse plane of 
vehicles, i.e., the cross-direction medial axis of vehicles, is contained in the method of the infinite 
distance reflected to the whole right-and-left width of face in this way, and the method of infinite 
distance of this transverse plane is horizontally displayed above bumper corner 90' of self-vehicles 
on a monitor. 

[0044] (The image display method of a control unit) Next, the monitor as a display means uses the 
display 5 of navigation equipment with this gestalt. Such a monitor is installed near [ installment 
panel ] an operator's transverse plane. And sensation in case an operator looks in at this screen will 
be naturally recognized to be the front of a travelling direction as all of a traffic sign, a map, etc. on 
a road are considered as the notation the upper part of the screen indicates the front to be, at the 
same time it catches the screen upper part a physical top. Being recognized as back is also natural 
at the same time a screen lower part catches the physical bottom. Then, the screen display of this 
invention is made on the principle of such recognition. 

[0045] An actual method sets up the posture of a camera 21 so that each image shown in drawing 7 
may be obtained. Specifically, they are the cameras CR L and CR R of vehicles back. The sense is 



file://H:¥JPOEn¥JP-A-2000-238594.html 



2/11/2004 



JP-A-2000-238594 



Page 1 2 of 23 



attached in the so-called vertical reverse one. Namely, camera CO which looks down at right under 
as are shown in dra win g 1 , and an operator sets an optical axis by the vertical line in the condition 
of having sat on the driver's seat, first and the body front turns into the screen upper part It 
supposes, having leaned the optical axis to the front and a left from the condition, and having leaned 
to the right further at the circumference of an optical axis — camera CF L it is — having leaned the 
optical axis to the front and the method of the right similarly, and having leaned to the left further at 
the circumference of an optical axis — camera CF R it is . moreover, having leaned the optical axis 
to back and right and left, and having twisted right and left further similarly, at the circumference of 
an optical axis — cameras CR L and CR R it is . However, the inclination of a cross direction and 
the inclination of a longitudinal direction are shown in drawing, and torsion of the circumference of 
an optical axis is not shown. If it is set as such a posture, a desired screen will be obtained only by 
displaying on a display 5 as it is. Although photoing back with a camera, carrying out the right-and- 
left reversal process of that image information about this point, and considering as a mirror image 
which is looked into with the so-called reflector glass of displaying on a monitor is also considered, 
although a system is complicated, since it does not suit sensuously, such a gestalt is not taken with 
this equipment. In this way, the image obtained is white line W'L L of right and left on a screen, and 
W'L R, as shown in drawing 4 . Actual white lines WL L and WL R seen from an operator's location It 
comes to agree in the sense. 

[0046] In this way, the image information obtained shall be chosen according to a location, a 
condition, etc. by making to stop the display to the necessary minimum according to a demand of an 
operator into a radical Motohara rule, and the operator shall be provided with it. The processing flow 
of the whole system constituted in accordance with this meaning is shown in drawing 8 . 
Fundamentally, this system is divided in accordance with the class of operator actuation, and 
consists of intentions which support the ****** actuation shown with the sign A which attached O 
mark on drawing, the obstacle-avoidance actuation similarly shown by B, the parking actuation 
shown by C like the following, the blind corner actuation shown by D, the back dead angle check of 
E, and the white line check of F, respectively. 

[0047] At the first step S-1, data read in is performed from the input unit 2 which constitutes the 
system of drawing 2 that the contents of exchange of above-mentioned A-F should be realized. And 
the function which operates in consideration of safety and need by the speed region at the following 
step S-2 is divided. That is, when it is the following step S-3, and an ON judgment of Selection SW 
(switch) is made, when decision of a low vehicle speed region is materialized from the input of a 
speed sensor 25, and this is materialized, a screen display according to selection of ****** 
actuation of A, obstacle avoidance actuation of B, parking actuation of C, or blind corner actuation 
of D is performed, the crown where decision of the low vehicle speed region of step S-2 is abortive 
on the other hand — when it is a vehicle speed region, display processing of the back dead angle 
check of E and a white line check of F is performed. In addition, what is necessary is just to set up 
those concrete setup according to an individual by test evaluation etc., although different criteria for 
every function are required about a detailed speed region. 

[0048] Next, when switch selection [ which / of A-D ] is made in the case of the low vehicle speed, 
the function corresponding to the selection SW operates. Since these functions are functions of 
another purpose which became independent fundamentally, the multiple selection is constituted so 
that it cannot do. In addition, even when the switch is not chosen, the system is constituted so that 
it may operate automatically in consideration of safety about the display function of obstacle 
avoidance actuation of B, and blind corner actuation of D. Sign B' which attached O mark all over 
drawing, and D' show these. Moreover, in the case of an inside high-speed region, from the function 
of a white line check of F, it leads to the function of a back dead angle check of E, and goes. The 
function according to these individuals is explained below. 

[0049] (****** actuation) The method of presentation in ****** actuation is maximum outside 
Rhine WBL of vehicles, and WB R, as shown in drawing 9 . Rhine LB L and LB R which took down at 
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right angles to the ground and extended the Rhine to the vehicles cross direction (parallel to a 
vehicles medial axis) It is based on what is displayed in piles on a screen. In this case, maximum 
outside Rhine LB L and LB R Outside Rhine of a tire may be displayed instead. Furthermore, these 
outsides extension Rhine can also be considered as Rhine which did not necessarily need to double 
with the maximum outside of strict vehicles, or the maximum outside of a tire, and gave the margin 
of the about [ 20cm ] from those maximum outsides. As an option, as shown in drawing 10 , it 
corresponds to the amount of steering rudder angles, and they are the prediction loci LB S and LT 
S of maximum outside Rhine of vehicles, or outside Rhine of a tire. How to display, as shown in (1) 
of drawing or (2) is also considered. How to display this prediction locus is explained to details in the 
place of obstacle avoidance actuation. About the pattern of display Rhine, as shown in d rawin g 9 , it 
can consider as two or more Rhine of a single straight line or 1 0cm gap degree, or the picture of a 
tire is attached and various gestalten, such as making it a three-dimensional expression so that the 
ground and the lateral surface of vehicles can be imagined, can be considered [ **** / making tire 
outside Rhine imagine ]. 

[0050] Next, the conditions which display are subject [ to an operator choosing ****** ] by the 
selection SW shown in drawing 2 . The processing flow by this selection is shown in dra win g 1 1 . 
****** actuation is made only into the low vehicle speed, and is not operated with the high vehicle 
speed. Such ****** actuation is dangerous at the time of high-speed transit, and it is because the 
image information itself may distribute an operator s attentiveness. First, when meaning bringing 
near by the slot in left-hand side as much as possible, and stopping during advance transit, an 
operator chooses a left-justify SW. This selection is judged by step SA-1. If it becomes below the 
vehicle speed beforehand set up in the condition, since under advance transit will be materialized by 
decision of step SA-2, it is the processing image PF L of step SA-4. It is displayed. Then, an 
operator is leftmost outside Rhine LB L of the self-vehicle to superimpose for the purpose of the 
slot on a screen. It is carrying out operation so that it may double, and ****** is made easily. If 
****** finishes and a shift lever is put into "P" range position, the input of the position SW( switch) 
23 by it will be judged by step SA-1 1, Selection SW will be canceled by step SA-1 2, and ****** 
exchange will be completed. Otherwise, as for this condition resolutive, a shift lever is considered 
for beyond vehicles halt fixed time amount or an engine shutdown by brake SW (switch) ON beyond 
vehicles halt fixed time amount by "N" range position. If a shift lever is made into "R" range 
position when it is necessary to go astern according to a condition in the middle of ****** 
actuation, an image is PR L by step SA-5 by the decision of step SA-2 by the input of a position 
SW(switch) 23. It replaces and becomes a go-astern exchange screen. Especially in go-astern, since 
the before [ vehicles ] lefthand corner section sways right and left, as it is shown in the upper right 
of drawing 1 1 , they are Images PF L and PR L It is effective to take the method of presentation 
displayed on coincidence. In addition, although the above explanation is premised on the general 
front-wheel steering device, in the case of the four-flower steering device adopted as some 
vehicles, it is effective to consider as 2 image coincidence display, as shown in the drawin g 1 1 upper 
right also at the time of advance. 

[0051] On the other hand, right justification decision of step SA-1 is materialized by selection of 
right justification SW and it becomes the screen display of step SA-6 or step SA-7 according to 
go-astern-before step SA-3 decision to bring near vehicles by right-hand side according to a 
condition. Moreover, if the center SW of ****** is chosen when passing through the place which is 
narrow with the time of passing on a narrow path, the obstruction, etc., it is decision by step SA-1 
and step SA-8, and the right-and-left image of one of a front and go-astern can be displayed on 
one screen by step SA-9 or step SA-10 at coincidence, and exchange suitable for operation can be 
offered. In addition, except the left brink **** screen in drawin g 1 1 , a part of incorporation image is 
omitted, it is what simplified and showed the screen and the actual display screen contains an image 
pick-up image like a left brink **** screen. 

[0052] (Obstacle avoidance actuation) The method of presentation in obstacle avoidance actuation 
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is the passage prediction locus LB S of the left ventral horn section corresponding to the steering 
rudder angle as shown in drawing 12 (example which avoids the vehicle under parking in front by the 
image of a forward left corner). It displays. With a natural thing, it is the prediction locus LB S F at 
the time of advance. Prediction locus LB S R at the time of go-astern It distinguishes and displays. 
Prediction locus LB S in this case Rhine is displayed not on the basis of the assumption line on the 
ground like [ in ****** actuation ] but on the basis of a left corner maximum outside. As shown in 
drawin g 12 , the purpose avoids obstruction N\ and this reason is for making it intelligible for an 
operator. Distance line LK which in the case of this screen serves as a standard of a gap as shown 
•n drawing 13 How to display is also considered. Moreover, when dark [ in the outside of a vehicle ] 
and the color of the self-body is a dark color system, and the shadow of the self-body or other 
bodies is reflected in reverse with the light of the sun or a floodlight at a road surface, it may 
become difficult to distinguish the outline of the self-body at **. As shown in drawing 12 a sake [ in 
such a case ], it is the border line (the outermost bridle wire of a self-vehicle) LP F of the self-body 
in piles to the outermost edge of self^body 90\ It will become very intelligible if it superimposes on a 
screen. As for this, the same is said of the case of other functions. 

[0053] The conditions which perform the display in this case are limited as well as the case of 
****** actuation according to the processing flow shown in drawing 14 at the time of the low 
vehicle speed. When an operator operates the selection SW(s) (for example, front left etc.) shown in 
drawing 2 , it is decision of step SB-1 according to it, and the image (for example, drawing 15 ) of a 
corner which corresponds by step SB-2 is displayed. Prediction loci LB S F and LB S R of the body 
corner then corresponding to a steering rudder angle and order ** based on the input of the 
steering rudder angle sensor 26 It displays collectively. This display is terminated by discharge 
processing of all the corners SW by step SB-4, when all the detection distance of a distance robot 
28 becomes beyond a reference value by decision of step SB-3. Moreover, when a switch is not 
chosen, it progresses to B' by decision of step SB-1, and the detection distance of the distance 
robot 28 of each corner becomes below or more one reference value by decision of step SB-5, and 
when the distance is approaching further by decision of step SB-6, while displaying the image of the 
corresponding corner by step SB-7, it warns an operator by step SB-8. An example of the display 
screen in that case is shown in dr awing 15 . The before lefthand corner section is taken for an 
example by a diagram, and it is the picture MI of a self-vehicle. It is the image PF L of the before 
lefthand corner section to the location which displays the before lefthand corner section with 
alarming coloration, or is blinked, and corresponds. It displays. Warning may be further performed to 
voice and a sound. Since there may be plurality, the corner which corresponds with a natural thing 
should just add two or more images and warnings all over the screen of drawing 1 5 in that case. 
[0054] (Parking actuation) Here explains as an example the case of back space parking said to be 
the most difficult by parking actuation with reference to drawing 16 . In this actuation, a target 
parking space will be checked in the location of **, and it will move forward to the parking actuation 
starting position of **, and will stop in the parking location of ** through the location of ** by go- 
astern. The points parked with sufficient performance at this time are how the parking actuation 
starting position of ** is judged, and at what to aim in process of **. It is the location of ** in 
principle, and when target parking-space U has entered inside (it is the upper part on drawing) from 
the minimum turning radius R of the vehicles, a car cannot be parked by once but cut actuation is 
needed. As a general standard, since the minimum turning radius of the usual passenger car is 
around 5m, the method aiming at the vehicle L-2 (location assumed when there was nothing) of a 
two-set next door of a parking space is used. Most operators depended on a habituation and 
admiration, and have decided the location of **, and it is difficult to dedicate without cutback 
actuation to the location of **. 

[0055] To then, the display on the monitor of an image by which the method of presentation in this 
case is incorporated with a camera 21 either of on the right-hand side of [ left ] the parking 
necessary space containing a part for the additional coverage space needed for vehicles right and 
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left when it reaches by the go-astern which makes a handle the maximum rudder angle — a near 
side (the case of back space parking to left back — from vehicles — seeing — left-hand side — ) In 
back space parking to right back, it sees from vehicles, and it superimposes the range which can be 
parked bordering on right-hand side. If the case of back space parking of this to left back is 
explained concretely, as parking actuation starting position ** shows to drawing 17 , it is the 
parking-space range ZI to an after [ the left ] image. It displays. This parking-space range ZI When a 
steering is cut from parking actuation starting position ** to max and it dedicates to aim parking- 
space U of drawin g 16 as mentioned above at the posture (it is the posture of a right angle to **) of 
** It is what is set up as a possible field which can give additional coverage to vehicles right and 
left. The boundary line of the longitudinal direction shown in drawing 17 is the left-hand side limit 
(when the concept of this limit is temporarily gone back and expressed to the location at the time of 
location empty vehicle both back space initiation of an actual display, a fictitious outline comes to 
show to drawing.) which had a predetermined margin to the vehicles side. The boundary line of a 
lengthwise direction shall show the limit that it becomes the posture of ** and a predetermined 
margin can be taken ahead [ vehicles ]. It is white line W'P of aim parking-space U' (set up so that it 
may leave a predetermined gap to front and rear, right and left of vehicles in this very thing and a 
parking location) specifically reflected in a screen as shown in drawing 18 . It sets up so that a 
display configuration may suit criteria. The setting method shall be based on an experiment or shall 
be based on count from the design basis of a vehicles item, the item of a camera, the anchoring 
item to the vehicles of a camera, a display item, or a parking lot etc. When it regards as a screen by 
parking actuation starting position **, as it is shown in drawing 17 by actual operation, it is the 
parking-space range ZI. If aim parking-space IT enters with additional coverage operation will also 
have additional coverage, and can do it and it is shown in drawing 18 — as — white line W'P every 
direction — receiving — parking-space range ZI a boundary in every direction — about — if I am 
doing one, it will be dedicated to the posture which does not have a position and an inclination 
barely by the go-astern which cuts a steering to max. Therefore, parking-space range ZI from the 
location shown in drawing 18 As for a gap in a lower part, parking actuation starting position ** 
expresses back past and a gap to the left means that a parking actuation starting position 

visits left-hand side too much. 

[0056] Next, when resulting [ from parking actuation starting position ** ] in parking location ** 
through the location of ** the middle, as shown in drawing 19 , the image of back right and left is 
copied on one screen at coincidence, drawing — like — left-hand side — the image PR L of left 
back — right-hand side — image PR R of right back arranging — each — Screens PF R and PR R 
of drawing 9 the same — maximum outside Rhine LB L and LB R It displays. This Rhine responds to 
a steering rudder angle, and is the prediction locus LB S R. You may make it display. What is 
necessary is to carry out test evaluation and just to decide the display interval of an image on 
either side, although it sets up so that feelings may seethe with an operator. Arrangement of the 
image shown in d rawi ng 19 is Images PR L and PR R. Although it is a respectively independent 
image, since it has the wide angle lens that each looks down at a self-body corner and the method 
of infinite distance, the range shown by R of drawing 1 can be seen in piles. Therefore, the gap of 
two images can be taken or very easy processing of cutting and putting the inside in order can 
constitute a back false composition image. 

[0057] Moreover, as shown in drawing 19 , it is the aim parking datum line WI. It becomes intelligible 
by displaying. This datum line WI The parking-space configuration at the time of parking vehicles at 
a standard parking space finely is superimposed on a screen. That is, as shown in drawing 19 , it is 
the aim parking datum line WI to aim parking-space U during parking actuation. If it is operated so 
that it may double, to aim parking-space U of the self-body, a gap on either side, the location of 
order, and an inclination can grasp clearly at the time of the completion of parking actuation, and 
parking also of an unripe operator will be attained finely at it. An operator is this datum line WI. 
Operation is carried out so that it may double with aim parking-space IT reflected on the screen. 
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moreover, these displays — in addition, if an alarm is emitted and it is made to carry out image 
display with the obstruction sensor 28 and camera 21 of front and rear, right and left of vehicles 
which are shown in drawin g 3 like the case of obstacle avoidance actuation of B when it is likely to 
contact, safety can be raised more. Although this parking actuation exchange technology is 
applicable similarly [ in column parking and inquiry parking ], it omits explanation here. 
[0058] The conditions which perform the display in this case follow the processing flow of the 
actuation shown in drawin g 20 . Also in this case, it shall support like said two actuation only at the 
time of the low vehicle speed. This flow is started because an operator chooses the parking SW 
shown in drawing 4 . In left rear parking shown in drawing 1 7 , an operator is SWPL In right rear 
parking, it is SWPR again. It will choose. When decision of step SC-1 according to this selection 
explains in the case of left rear parking, decision of step SC-2 in the input of a position switch 23 at 
the time of advance Step SC- It is the left rear image PR L by 4. The parking frame range ZI 
explained by drawing 19 is superimposed, and an operator is this range ZI. If operation is carried out 
so that actual aim parking-space IT may enter, it can go to the location of ** explained by drawing 
1 7 with vehicles. If an operator checks this condition and puts a shift lever into go-astern, they are 
two back images PR L and PR R by step SC-5. Carry out screen display to coincidence and 
corresponding to steering rudder angle prediction trace line LB S R to each corner It superimposes. 
An operator refers to this, and he does operation so that it may go into actual aim parking-space LT 
reflected in a screen. This flow is terminated by the switch discharge of step SC-9 by the shift 
decision to the parking range of step SC-8. 

[0059] (Blind corner) The image selection which relates to the theme of this invention and displays 
the incorporation image of the information on the crossing road on a monitor automatically is applied 
to the blind corner display, the method of presentation in the case of a blind corner is shown in 
dr aw ing 21 (example of image PF L in the case of a front left blind) — as — the image of the blind 
section — a counterpart and a it top — the standard depth mark on the ground from a self-vehicle 
— milepost LK ****** — it displays. The same is said of the front right and back right and left. In 
this case, as shown in the screen (1) of drawing 22 , or (2), according to order **, an image on either 
side may be displayed on coincidence. And the symmetric property of right and left in the 
coincidence display of a right-and-left image is taken into consideration in this way. About the 
posture of the camera explained at the beginning, add some modification and it is related with the 
optical axis X of a camera 21. As opposed to the camera 21 (for example, CF L) of the corner of the 
method of left Uichi of the vehicles installed in the posture in which the direction of a vertical plane 
containing the straight line which connects a camera 21 to an operator, and the same direction as a 
parenchyma top are turned to One law also installs the camera 21 (for example, CF R) of the corner 
of right-and-left another side in the posture of field symmetry to the medial axis of vehicles. It is 
the picture MI of a self-vehicle so that it may correspond to the middle of the screen at that time 
forward and backward. If it superimposes, it will become much more intelligible. 
[0060] The conditions which perform the display in this case follow the outline processing flow of 
the blind corner display shown in drawing 22 . As said Maine flow explained this flow, it shall operate 
only at the time of the low vehicle speed. And it is contingent [ on the blind SW (the front left, the 
front right, back left, back right) shown in drawin g 2 being chosen by decision of step SD-1 ]. Step 
SD- Before being based on input decision of the position switch 23 of 2, according to - go-astern, 
the piece side plane shown in drawing 21 by step SD-3 which constitute an image selection means 
and an index display means, or step SD-3, the screen (1) of drawing, or (2) are displayed. If it 
explains in the case of a screen (1), it is the front left image PF L. Front right image PF R Picture 
MI of a self-vehicle Milepost LK which arranges in the location to which it is made to correspond, 
and is generated by the index display means It superimposes. And this milepost LK An operator's 
gaze direction is also shown and the point at the time of a gaze is intelligible. In addition, in drawing, 
sign N' shows a field-of-view obstruction. 

[0061] By the way, it is the milepost [ image / on either side / each ] LK corresponding to the 
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crossed axes angle as a crossing not only intersects perpendicularly, but there was mostly when the 
direction P of the road which crosses to the direction O of a self-vehicle like the example of 
drawing 23 becomes slanting, and shown in drawing 24 in such a case. It will become more intelligible 
if it displays. The example of drawing is the milepost LK B in case whenever [ crossed-axes-angle ] 
is beta. Display direction betaL, betaR DashedHine LK which shows the milepost in a rectangular 
crossing Contrast shows. This value is uniquely determined as beta understood from the data of 
navigation from the item of a camera 21, the loading item to the body, etc. Although the crossing 
road is made into the straight line, and it may have bent or may have broken, it doubles with that 
condition, and the explanation in this case is Milepost LK. The display direction and display distance 
are set up. In this case, if the direction sensors 29 (refer to drawing 2 ) carried in the vehicle, such 
as a gyroscope and a compass, detect the sense of a self-vehicle with a sufficient precision, it will 
combine with the map data of a data base 4 (refer to drawing 2 ), and it is Milepost LK. A direction 
can be displayed with a sufficient precision. An operator can refer to this image, and can check 
safety on either side, and it can move forward. 

[0062] Furthermore, even when Blind SW is not chosen by decision of step SD-1 according to the 
feature of this invention, processing of D' is performed, by step SD-7, when it judges going into the 
crossing which does not have a signal by the Nabih information based on a data base 4, image 
display is carried out similarly and operation is supported. In this case, in addition to the traffic 
information from navigation equipment, approach in the crossing which does not have said signal 
based on the information on the transit condition of the vehicles inputted from an input unit 2 and 
the contents of operation can also be judged. Information on the transit condition of the vehicles at 
this time is made into the low vehicle speed information by the speed sensor 25 included by the 
input unit 2, and makes information on the contents of operation the brakes operation information 
by ON of the brake SW24 similarly included by the input unit 2. Furthermore, even when step SD-7 
are abortive, by step SD-8, also when the detection distance of the obstruction sensor 28 is below 
a reference value, it judges that a prospect is bad, and an image is displayed. 

[0063] (White line check) Generally, although an operator runs checking the self-vehicle location on 
a transit lane by that cause looking at the white line on a road surface, when running also Nighttime 
and day ranges while it is raining further at the time of fog etc., lane may be unclear and he may 
take pains over the localization. Moreover, the white line which displays the center line serves as an 
important check means to judge not only the localization but the propriety of passing each other, at 
the time of passing each other by the road of single-sided 1 narrow lane of the width of road. 
Therefore, it is also very dangerous if a white line cannot be recognized. Exchange of a check of 
such semantics to a white line is important. 

[0064] With this gestalt, a white line check is supported that such a situation should be coped with. 
Drawing 25 is the white line WL L on the left-hand side of vehicles., and it is shown. [ the equipment 
configuration of the image pick-up section in the case of copying ] [ **] [ type ] In this case, as 
image pick-up equipment, it is the camera CF L of the corner of the left part before vehicles shown 
in drawing 1 . It uses. Furthermore, similarly lamp 92' which irradiates the ground a left longitudinal 
direction and ahead of the left is prepared in the corner of the left part before vehicles (this lamp is 
used when vehicles have been equipped with side lamp 920, and it is a white line WL L. If it 
illuminates, it is a white line WL L more vividly. It can check by looking. It is a white line WL L, 
without being dazzled by the light of the headlight of an oncoming car if it does in this way. A check 
by looking becomes possible. 

[0065] The processing flow of a white line check is shown in drawing 27 . As conditions, it is more 
than a certain fixed vehicle speed by step S-2 of the Maine flow shown in drawin g 8 . The headlight 
lighting decision by step SF-1 by this flow is materialized. The time of the wiper actuation decision 
by step SF-2 being realized in ON of a wiper SW24 Nighttime, The inside of rain is judged to be 
under transit, at the time of blinker SW the non-operating decision by step SF-3, a side lamp is 
turned on by step SF-4, a front road surface is irradiated from a left lateral, and the screen of 
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drawing 26 is displayed by step SF-5 which constitute an image selection means. In addition, 
although not shown in a processing flow, as other conditions, above the same fixed vehicle speed, 
the poor field of view by the heavy rain is judged, and same processing can be performed by judging 
a poor field of view by lighting decision of a fog lamp being materialized, or strong actuation decision 
of a wiper being materialized. In the above-mentioned flow, it moves to the processing flow E of the 
back dead angle check which carries out a postscript when the decision in rain or decision of a poor 
field of view is abortive at night, even when both the above-mentioned decision is formation, the 
requirements for decision of the flow of a back dead angle check are ****(ed) at the time of winker 
actuation, and it is the back dead angle screen EL Or ER It will display. Moreover, side lamp lighting 
is not necessarily a requirement. It is the cameras CF L and CF R of front right and left to the 
direction of headlights, such as an oncoming car. Since the directions of an optical axis differ 
greatly, even if the light of an oncoming car carries out specular reflection to the water screen, it is 
because it is possible not to go into CCD of a camera, but not to be dazzled, and to catch by CCD 
since the reflected light from a white line is scattered reflection. Therefore, it is fully a little 
detectable from the side of a self-vehicle to the front using the lighting of an oncoming car, a 
consecutive vehicle, the next vehicle, a self-vehicle, etc. Thus, side lamp lighting is for making it 
further easy to be visible. 

[0066] As the display screen, as shown in drawing 26 , it is the camera CF L of the before lefthand 
corner section on the same display. Camera CF R of a front right corner An image is copied. They 
are white line W'L L on either side and W'L R so that feelings may seethe with an operator at this 
time. It is desirable to set up so that it may become the same as the time of taking a photograph 
with the camera whose relative relation is one. Moreover, it is the border line LP F of a self-vehicle 
as previous obstacle avoidance described with the method same since the self-body in an image 
stops being able to be visible easily when the color of the self-body is dark. If it superimposes, 
distinction with a road surface will become easy. 

[0067] By the way, under such an ill condition, an image becomes tends to become indistinct only by 
displaying a camera image as it is, and it may be hard to recognize to the driver under operation. 
Then, it is also effective to make it be easy to recognize by the following methods. 
[0068] The modification shown in drawing 28 is the method of superimposing the graphic form which 
carries out highlighting which makes a white line conspicuous by the image processing, or expresses 
a white line on an image white line. In this case, after display processing of step SF-5, white line 
recognition and recognition of an inclination will be performed by step SF-6, and processing which 
superimposes the graphic form which displays emphasis or a white line for the white line on an 
image by step SF-7 based on it will be performed. On a drawing, it is expressed as the dashed line. 
A foreground color does not adhere to the white doubled with the white line, but should just use the 
color which is easy to check by looking to a driver. 

[0069] Next, drawing 29 shows the 2nd modification which displays a white line graphic form with the 
HUD (HUD) which used the windshield. Also in this case, after display processing of step SF-5, 
white line recognition and recognition of an inclination will be performed by step SF-6, and HUD 
display processing will be performed by step SF-7' based on it. Let a display position be the location 
which laps with the white line location doubled with an operator s actual look. According to this 
method of presentation, since an operator can check a white line location like real, without diverting 
a look, with an operation field of view maintained, the advantage whose safety improves is acquired. 
[0070] When the white line which advanced the display function further and detected it separates 
from white line tolerance, or when it is separating, it warns an operator of the 3rd modification 
shown in following drawing 3 0 . The case where a self-vehicle is separating on left-hand side by a 
diagram is illustrated. As processing in this case, white line recognition by the step SF-6 [ same ] as 
two examples and recognition of an inclination are performed a front after display processing of step 
SF-5. That result, It is the comparison with the white line tolerance beforehand set as the fixed 
location on a screen to the self-vehicle location, and by decision of step SF-8, from tolerance, the 
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white line of an image should just warn an operator by step SF-9, a blank or when it becomes that it 
is likely to separate. Although various the concrete warning methods are assumed, there are the 
methods of carrying out character representation, like "it has separated on the left", for example 
like illustration. 

[0071] By the way, the various proposals of the method of utilizing white line detection technology 
for rain blank warning etc. are already made. The conventional camera for white line detection in 
such technology is a cable address CCDO to drawing 31 and drawing 32 . Usually it considers as the 
arrangement which photos a front white line over a bonnet from the neighborhood (usually reflector 
glass neighborhood) of a driver s seat so that it may be shown. When it does in this way, an image 
pick-up can be made to approximate to the viewing angle at the time of operation of an operator 
mostly, and there is a big advantage in that a white line on either side can be seen to coincidence. 
However, by this method, a white line is seen in a shallow angle and the direction of the side to a 
road surface, and it sees in angle thetaO v and the direction of a plane, and is angle thetaO H. And 
there is a problem in that a distant place will be seen. That is, if it will be in the condition that a 
water curtain is made to a road surface in a rainfall, as [ show / in drawing ], seeing at a shallow 
angle will become a failure and it will become difficult to see the white line of the road surface under 
it. If especially confused by the reflected light of lighting of **, such as a rear LGT of the headlight 
of an oncoming car, or a precedence vehicle, and a street LGT, it will become impossible also on the 
image pick-up with a camera to white line detect a driver the same with the ability of a white line 
not to be seen on real field of view. Moreover, it becomes a failure to see a long distance on the 
contrary, in the case of fog, smoke, etc., it will see through the layer of a thick fog or smoke, and it 
becomes too impossible to white line detect [ of the road surface in a camera ] them. When an 
operator is not seen, just by making rain blank warning etc. appropriately, it is worthy, but if 
detecting becomes impossible together with a driver by the above camera arrangement, the value as 
a support system is not useful. 

[0072] About this point, according to the white line check of the above-mentioned operation gestalt, 
a check-byHooking improper condition can be detected, and the road surface condition of self- 
vehicle nearness which is not confused by such condition can be detected and supported. In this 
case, the camera CF R of the right ventral horn set up as stated to the beginning based on the 
basic thought of this invention (a cable address CCDH shows in drawing 31 and drawing 32 ) has 
semantics important for the point moreover looked down on at a perpendicularly near angle to a 
road surface from the location near a road surface. Angle thetaH V which looks at the ground in the 
direction of the side as shown in drawing 31 Near, therefore the road surface very near the self- 
body will almost be seen to the perpendicular very greatly (thetaH V »thetaO V). Moreover, as the 
direction of a plane is also shown in drawing 32 , it is angle thetaH H. Angle thetaO H A possibility of 
being confused by the lighting of an oncoming car becomes low sufficiently greatly (thetaH H 
»thetaO H). Thus, it sets up, and for the first time, also in the case of a thick fog [ the frightful 
heavy rain in Nighttime, or ], a white line can be photoed, an operator is provided with an image, and 
it becomes possible to recognize the location of a self-vehicle to a lane. Moreover, if an image 
processing is carried out like a modification 1 or 2, white line recognition can be made still easier 
also under such an ill condition. Furthermore, exact warning like a modification 3 is also attained. In 
addition, although illustrated about the camera CF R of a right ventral horn (CCDH) by a diagram, a 
thing with the same completely said of the case of the camera of the left ventral horn which omits 
illustration can say. 

[0073] As for drawin g 33 , the object of the sea bed by the reflected light and the underwater 
transmitted light in the water surface appears, and it shows the relation of the direction 
theoretically. The underwater transmitted light shown in drawing as a continuous line is an angle 
theta 1 to the reflected light in the water surface which a correlation is realized between the 
intensity of lights which carry out surface reflection like illustration with the angle theta which looks 
down on the water surface, and is shown in drawing with a dashed line. Strength is reversed as a 
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boundary. Therefore, angle theta 1 It is an angle theta 1 to being interfered by the water surface 
reflected light and a sea bed being unable to be seen in a small angle field. In a large angle field, it 
will be in the condition that a sea bed can be seen, without being interfered by the water surface 
reflected light. Angle theta 1 in this case Camera CCDO of the above-mentioned former [ taking 
in / the image in a small angle field ] It is in charge of the image pick-up to depend, and is an angle 
theta 1. Camera CCDH in a large angle field Taking in of the image to twist is in charge of an image 
pick-up with the above-mentioned operation gestalt. With the above-mentioned operation gestalt, 
the white line check under SIGMET is enabled using such a principle. 

[0074] (Detection of a white line) In addition, the operation exchange equipment of this operation 
gestalt is applicable also to detection of a white line. Although explanation is omitted about the 
concrete technique of white line detection since it is common knowledge, those many are installing 
the camera near [ windshield ] the vehicle interior of a room as mentioned above at dedication. 
White line detection can be made to perform with this equipment to it using two cameras of the 
right-and-left-before vehicles corner prepared in dead angle detection as mentioned above, by 
detection of the white line beside [ using the size of the field of view of the longitudinal direction 
which be the feature of this operation exchange equipment by carry out like this ] the self-vehicle 
neighborhood , while relative position relation with the self-body be detectable with a sufficient 
precision , as the display of the aforementioned white line explained , it be detectable also at the 
time of the Nighttime rainfall and fog — etc. — an advantage be acquire . And it becomes cheap for 
other functions and combination. 

[0075] (Back dead angle check) The theme of this invention is started and the image selection 
which displays the incorporation image of the information on vehicles back on a monitor 
automatically is applied to the back dead angle check. The flow of a display of the back dead angle 
check which leads to draw ing 34 with previous white line detection is shown. This display by the 
decision of step SE-1 which is more than the setting vehicle speed and the Nabih information shows 
Two or more lanes of one side, Furthermore, when the winker actuation by step SE-3 is judged 
during transit by decision of step SE-2 in the place which it is not near the crossing When it 
performs by judging it as passing or interruption and winker actuation is not judged, it responds to 
the action of vehicles, and it is E1. Screen selection by processing is performed. It is EL when there 
is winker actuation of the left or the right. Or ER The back image which corresponds by processing 
is displayed by step SE-4 or step SE-5. Moreover, when there is no winker actuation, processing 
shown in drawing 35 is performed. 

[0076] E1 shown in this drawing 35 By processing, they are the cameras CF L and CF R of the front 
left and the front right at the original step SE-10. White line detection to depend is performed, and 
when this detection is impossible, it is E2 as it is. Processing is ended without performing a screen 
display in a path. Step SE- The control line R1 of the every two right and left on image recognition 
when white line detection is possible, as shown in drawing 26 by 10, R2, L1, and L2 It sets up and 
judges by the motion of a self-vehicles image to these control lines. It is the control line R2 and L2 
here. It is a self-vehicles maximum outside production, and is the control line R1 and L1 . It is a 
predetermined distance ****** parallel line from it. Thus, a right white line is R1 at the following 
step SE-1 1 to the set-up control line. It is ER noting that there is a lane modification intention 
when it judges with having crossed on the left from the right, and the speed crossed by step SE-1 3 
judges that it is beyond a reference value and this is satisfied. It progresses and the above- 
mentioned image is displayed. Moreover, even when decision by step SE-1 3 is not satisfied, it is the 
control line R2 at step SE-1 5. When it crosses, it is already ER as under lane modification. It 
progresses and the above-mentioned image is displayed. On the other hand, in the case of no, a left 
white line is L1 at step SE-1 2 in step SE-1 1. It is EL, when it crosses on the right from the left and 
the speed further crossed by step SE-1 4 is beyond a reference value. The above-mentioned image 
is displayed spontaneously. When the speed crossed also in this case does not fulfill a reference 
value, it divides a display and un-displaying by the location decision by step SE-1 6. Thus, the 
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incorrect judging by wandering of the vehicles which are not meant etc. is avoidable by judging an 
operators intention at a location and migration crossing speed on the basis of the control line of 
every two right and left. 

[0077] An operator refers to this image and does operation. About lane decision, the lane which is 
running the number of lanes of the road it is running, and the self-vehicle is easily known using the 
white line detection technology expressed previously. Moreover, even if it uses the signal of the 
optical beacon currently installed in the highway, the same thing becomes possible easily. As for 
decision of passing or interruption, it can also perform using such information easily combining 
winker actuation. Of course, if it combines with the Nabih information, naturally information precision 
increases further. 

[0078] as mentioned above, although some modification was given and explained based on 1 
operation gestalt for the facilities of an understanding of the technical thought of this invention, this 
invention is not limited to the operation gestalt or modification of instantiation, can be variously 
looked like [ each claim of a claim ] within the limits of the matter of a publication, and can change 
and carry out a concrete configuration. 



[Translation done.] 
* NOTICES * 

Japan Patent Office is not responsible for any 
damages caused by the use of this translation. 

LThis document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

LQrawingJJ It is explanatory drawing showing the installation posture of the image pick-up 
equipment in 1 operation gestalt of the operation exchange equipment which applied this invention. 
[Drawing 2] It is the block diagram showing the system configuration of operation exchange 
equipment. 

[ Drawin g 3] It is the plan in which, and showing it. [ the arrangement to the vehicles of the image 
pick-up equipment of operation exchange equipment, and distance detection equipment ] [ **] 
[ type ] 

[Drawing 4] It is explanatory drawing showing the direction of the image pick-up equipment installed 
in each corner of vehicles, and the relation of a value monitor screen. 

[Drawing 5] It is the cross section which, and illustrates them. [ a cross section ] [ the concrete 
arrangement location and installation posture of image pick-up equipment over a vehicles corner ] 
[ **] [ type ] 

[Drawing 6] It is the vehicles front view which illustrates the concrete installation location of image 
pick-up equipment. 

[Drawing 7] It is screen explanatory drawing which illustrates the value monitor screen which 
displays a self-vehicle forward left corner. 

[Drawing 8] It is the processing flow **** flow chart of the whole system of operation exchange 
equipment. 
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[ Drawin g 9] It is explanatory drawing in which combining the value monitor screen at the time of 
****** actuation with physical relationship with each part of vehicles, and showing it. 
[Drawing 10] It is image drawing showing the example of a graphic form of a prediction locus display 
by comparison. 

[Drawing 11 ] It is the flow chart which shows the processing flow at the time of ****** actuation. 
[DrawingJ2] It is the screen block diagram showing the value monitor screen at the time of 
obstacle avoidance actuation in details. 

[Drawing 13] It is the screen block diagram showing the value monitor screen which superimposed 
the standard distance line. 

[ Dr awing 14] It is the flow chart which shows the processing flow at the time of obstacle avoidance 
actuation. 

[Drawing 15] It is the screen block diagram showing an example of the alarm display screen at the 
time of obstacle avoidance actuation. 

[ Drawin g 16] It is the sketch showing the location of each [ at the time of parking actuation ] 
vehicles at the time. 

[Drawi n g 17] It is the screen block diagram showing the value monitor screen of the aim parking 
space at the time of parking actuation. 

[Drawing 18] It is the screen block diagram showing a difference of the value monitor screen by 
location gap of the aim parking space at the time of parking actuation. 

[Drawing 19] It is the screen block diagram showing 2 image coincidence display screen at the time 
of parking actuation. 

[Drawing 20] It is the flow chart which shows the processing flow at the time of parking actuation. 
[ Drawing 21] It is the screen block diagram showing the value monitor screen in a blind corner 
display. 

[Drawing 22] It is the flow chart which shows the processing flow of a blind corner display. 
[Drawing 23] It is the sketch which illustrates the crossing in a blind corner display. 
[Drawing 24] It is the screen block diagram showing the value monitor screen in a blind corner 
display. 

[Drawing 25] It is the cross section in which, and showing it. [ the additional equipment configuration 
for a white line display ] [ **] [ type ] 

[Drawing 26] It is the screen block diagram showing the value monitor screen at the time of a white 
line display. 

[Drawing 27] It is the flow chart which shows the processing flow at the time of a white line display. 
[Drawing 28] It is the flow chart which shows the modification of the processing flow at the time of 
a white line display. 

[Drawing 29] It is the flow chart which shows other modifications of the processing flow at the time 
of a white line display. 

[ Drawin g 30] It is the flow chart which shows the modification of further others of the processing 
flow at the time of a white line display. 

[Drawin g 31 ] It is explanatory drawing showing the relation of the camera angle and white line 
detection function in a white line display by the angular relation-ship of the direction of the side. 
[Drawing 32] It is explanatory drawing showing the relation of the camera angle and white line 
detection function in a white line display by the angular relation-ship of the direction of a plane. 
[Drawing 33] It is explanatory drawing in which the object of the sea bed by the reflected light and 
the underwater transmitted light in the water surface is visible to, and showing the relation of the 
direction theoretically. 

[Drawing 34] It is the processing flow **** flow chart of a back dead angle display. 

[Drawing 35] It is the flow chart which shows the partial flow of processing of a back dead angle 

display. 

[Description of Notations] 
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1 Control Unit 

2 Input Unit 

5 Display (Monitor) 

6 Nabih ECU (Navigation Equipment) 
9 Vehicles 

21 CCD Camera (Image Pick-up Equipment) 

22 Winker SW (Winker Switch) 

24 Brake SW (Brake Sensor) 

25 Speed Sensor 

27 Wiper SW (Windshield Wiper Switch) 

SD-3, SD-4 An index display means, image selection means 

SE-4, SE-5 Image selection means 

SF-5 Image selection means 

SF-7 and SF-7' Image-processing means 

SF-9 Warning means 
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<^fc#«sftfcfi^i^©*ft**i«:HMit4 ura^ 
■r&4>©-e&£. 

[0 00 3] 

©t^Ttt. H 1 £a>0?fr4©lBMiH8©4»#>6 1 
[0 004] ££3<c;EftflHg««0t?&t» 

it?. -e©w c ttwr u i>m$mft<D3zmax 

^o-cjgfeLi^©^*^^ mmteffi$wmt in 
®cr$^. &sc»«aifp©0»$3!p6«a3tir» wffl 

*t*#T?*5»^ ^©a^^aK^tcatt** 

». ^©^©tKiaiciSDfc, ®^o-&g:Fpr^frk© 
tc*»3ft. L*4>»S9©a^ttLr»6nS:£**. « 

[0005] c 5 L^«tt(cs»tc$nyt«> 

©-C&9, jI!K«©5Eftia*<[Jii«a%m0i&«H«« 30 

«K©t«8ii»©^%. tttsfctsc-c, a^#©ma-r 
L/T att«K*-* c 4#s-ca £»K33gsi 

[0 006] 

a^©Ji««g 4 . &imi&b#k o iMHB«**Bi-r 

0SHKK. iSKtt«££»i»rffi& ^ t*^*- f 3 >^a&c 

a» s ■ mi- ^ 3 >$is^5©iigs« mm-? 

9. «-9©«ei>3)abS' , v©«iB*Wrl/ , c. S&ICBrtcS 
-3*. 3tH-r*aH8©tMB©Wii*lBflfe*e«iW{c*- 

[0007] mk. &mk7jk<Dtc&omm i m&$:±:i-f i> 

(c» . MnEMIKMKgPf ©jfeftttft 4 aUK&fEftg 4 
«. Buse^-try—>a>^ie*>6©jigSitfR{cjnA-c. 50 
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A*SSa*»6A*S *iSSP5©*ff tt»4 jUaftffirtS 

©««K«^#i^fi#©<ct»SEaL^©j8a*«K-r 
s»fiSi-ra©*qwftr**. 

[ 0 0 0 8 ] *t,T. SWB*W©jtff«W©««tt. * 

maflHs 4 -r -s ©a* watrc * 4 . 

U-*»ftflMB4'r-5©*«««rC**. 

[0010] 3i*3ti*inwt«©wffltt*ifiii± 

-XTSfg««^*gl*«itS«ia54ra©*»WSir* 

[001 1 ] miB&aitt. ^ttwcctt. e^*»e>©S6B 

±©S3cSgilf©S@«3 itiO^-c*^, 
[00 12] JgtC. B«fBeS9W. Isa.l&M 
36»6©MBW««:K-5< «fc •) . W&#iHflU:©£ 
*TSiB»©^ieiK:^to-&rSfefiR3ti*©3&s«»r* 

[0013] &{C. *JM9B. ^MKl^gSn, 9m<0 

tffs^BX 5 iAtj-«^©m0^a 4 . &j»&£sa*siR 0 & 

trm«*teHT4iWffll§SB4. RlHffll&8CC<i:r)«ia3 

ft*BMfc*asvr * * - 4 -sag^gjiatc 
iuiB*ij©ggtcmM©^tf t^zja 4 mtmr&m 

4&W«4UrA#r3A#RB*«*., MfBiMtSlitg 

ft. K^t'^->>3>^g^6©3SS&W$R«c*^^. j£ 
fflMSSwWWSt?* D . SS^IiKfiSfi UCl>fcl> C 4© 

©*tf 4 aiai^rt§©tftg 4 . $tj®)^a©H«te 
atc^ *) »6n**Pi©*tt©i>'j*ti*>*»e>*aiajs* 

[0014] C©iS^-. «MBmiS©j£fftt«14aiKftffi 

F**g©t»*8«. *<*w(c». A^s^atc-a^^tismii 

H2>1f-«:j;^iifmiitffR4^^>*-x^ 9*<omft 
flBR"TS©3&s#«rr*s. 

[00 1 5] */c. SITiB*l9©^tt». IB^±T'igIi3 

[0016] &tc % msicsa^n. ^w© 

«$S^m i PjAtf^©^^a4. ttftfttiKa*SR9& 

ti%m&*mK-$ - 4 sais^^aK: 

fcUT, NCHM)ta(can©j£f7KR 4 SM£8im*3S§ 
i*t»«4b-CA*-rSA*aSB*«A. wfiB*«JfflI^a 

«. A^>iia*^©ai0s^^cs^. its§±-c© 
am{4a©^*«fflSi^^ta**'J»r . tumncmn 

¥ifffl!W©1»«©lRji*!B«i*e«iW«c*-*-{c 
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[0017] e©*»^, BuieaigsifPrt^tt. A7Ji$a 
©#w$rc&.s. 

Co o 1 8 ] ifiaaiKgif'Prt^t*. A^KJwca 

^3 n£ "7 ^ » ^©&fp«:<fc & -7 ;<-fHW» 

«£-r*©t>w&T?*s. 

[0019] »c. ftlB&lfflggBK. HXji*iB«±©@ 
«^*ISfiA:1i'*liI««ffll#R*'ad-rsofe*J»r* 

[ 0 0 2 0 ] Efc. iiufa*iJ*3Pilg«. BHfc±TlM&Sft 
[0 02 1] 

[»"B©fffflRC«a*3 ±KUI*3S 1 !2«©«lRSt?tt, 

jes cc <t & 3c±<mMi^-m'Smt£mn<o a c 

*5C»T> »feWBt3fti8tS*»c*'J-SS^-r*aK©5E 
M##R£> S f S > < J C i A5f 

©fc»©flWR4 0T. M#©#fc#^«>«»3ft-Cl>& 
tty-; ^3>ilK©tW8£ffil^ TC£ffiKKlcHtt 

©xn^itfRc^-ft-^^ais-r lt 

[0 02 2 ] IK, M*B2BE«l©««6rtt. SKl^ 

[0023iflt, IS*«3fetg©1«^rW. Bill, 
©13 iS£S.*-s©Sffi©SI!*i lr©^fm«*fS 
©^^©^^W^JBrS^i LT^Sfc*. &**©& 

[0 024] *fc. tt3j8E4K*S©«fi5-Ctt. HMO© 
i^*^©Sj5©Sl*<!: b-C©^U-*»f^*jI 
ISftfp©a{tte|«BrB3R4 0rt>*A:». Slm©<&gtt 

[0 o 2 5 ] wk x i»*^5ie*s©«^-c«. ejg©@ 

IIi«*6©iffl&^©*J»r&g|J«:-r.&C itfTSS. 
[0 02 6] MiC. »3jSB6iett©«fifrett. 
H»©ffi*tc J: 9tt£»l©Btt&EIHB£*lje L>T. 
BMft*6©aiHlttiR*I»r*— JBSSfc-J-S C 
4. 
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[0 0 2 7 ] mc. »*5l7Ktt©«fiRrtt. }g«3^ 

[oo2 8]»c ti*3i8fais©^-ctt. 

i wflfiw©3si<i!»EftflWR*a»«j*»o5r w 

**r*£. Uj&»<>. g«t*^©fci?>©titf8£ It, j£?f 

*»»*a»r*o . safaa«c«aori»j&:i»c £©« 
io w*. *IR«4aa^©ffli»i6*P*s^snri»s^-tr 
y-^H>asB©««4ffll>. SI££fl&tBtcS?r©£ 

»§t«$g©x-^^-^4a^-r^^^^< in^fc 
a& v »a©awE*we<b-*-*ci*»-r*s. 

[002 9] igtc, »3|»B0iBtt©«JiS-Ctt» 

©ats©sK4 or©*3SH2>if-(c<fc^iifmat»fR<!: 

[0 0 3 0 ] MtC. ffj&l I OISK©fllRJErtt. 
20 ^A-X^^CDaMlTb^l^ri, miE 

[0031] acjc, m&s 1 1 iafg©«^-ctt. graft 

MB#©*tiSj^©-^ f h©Jg*f(Cj:.5B&& ffiffl-C 

©^©^*n$^*MB$©mi?^m^©^ii^^^mm^ 

0T3Hi©lSj**W«:*C4t?S»©iai*5Wr. * 

««aar* e>©aei*R«*ffli»r $ -_t«: gmra 

[003 2 ]fLt, l»3}<^ 1 2X1* 1 3ia«g©«fiSr 
B. e^©iS^lig(c <fc S g^{ig©*iJW*sHit^jjE 
mM(Cg£#©A7^^g«C J: K) fS^cWET & Ci*5 

[003 3 ] SiC, Sft$£ 1 4l2tt©«fiSt?tt % B«± 
[0034] S(C, 1 5tBtt©«teRTtt. Sffi 

«©w«8^raiftttisi^©KiaT'r©jiK3aa* j: o 

Jfi^^c © £ r 4 C L ifi-C # S . 
[0035] 
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£*ji«t*?- ty— > 3 >gg©7" b'E c u 6 (c^fii 

3nt(,>£„ CtKCfcD. *ff^r«, X7"b-5 

c>Ttt. S'J&#ffl©&©£t3:ttTk<fc<. *©»£. ^ 

[0 03 6] 03fcS2§£mir<fc5fC. AMt©l-3 
^ES-TSfll^gil/r. HicOEnr^-rccD^y 
^2 1 (JUT. *^v<bBSfai/. ffl^O^^^^rESiJ-r 

F L . C F r , Cr l Cr r ,C m L . C M R ^"f^t 

s» 1 . s, t . s, R , s t , , s, , &i T i~$~) 
sgp©**Kfcsi3nri^. cfte>iEitfctti££g2 

©^^ia^^tiiai^® 1 Prcmmmm.-? 

*>c £tc£ 0 j^SW(Ci^ilt^*8?> itSCi 

30 

[0037] *&w<D£ssicm?>mm3a&&ft stmt 

tctfi-oX. ^ftznmTZtcMc, «MR«{KK:oc>r 

?Z>. 40 

[0 03 8 ] (SM^H©RBjg») HI {c^-T J: 5 
H«. A,D F t . Df r , Dr r , D R t (CB£ft&@ 

•5. C*ltC>tfUT. C©H;i&U4Bia£#^-b. Ofr 
tf# 6ti ^>ili^m#R^31te^©^«:cc— 3 
fC. tSSgg§|&©f&l (DI^ilT, SW7 2 1«, -5- 
©IRii^iii^iOiffiiJ^SM©^^^^, ^oSifiT 
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[0 03 9] COiBgtCjQO. ^MftSPK^gT-SS* 

y^2 1 K-oi^tt, -e©sg{igcc^f&-r-smw©^ 

SC£ tT©@mft©ftg|5£. ^©M^^tfiWJia 

c©WW©A»«:oc»t. #(ci5B$©^ffl^ 
-Sfctf). &TU<>SMI8£0fcl»**. #»9itt:§5*PS© 
»*«f*©jE»*3§WtL. «fc 9 JM*W«:«. m^©M 

vo^-©a©^#«t*jttiwcai»ii**'c/j , *;s < & 
mfttftfr 6 . mM©Hu^so*ffl"j^xBf^s.o'fflij« 

r » . p. t . Pr , *^-r«fc5tc % #**f*©ar« 

Jc^frcfc^tt, S*^7C f t . C F „ . C R t . C 

» » ©»»*K3rr*. h«c*ji»-c. mg-5§w L t , w 
t r «s§M©tm w t t , w t , «B*«±©e 

Sl. ^9 0' »*WHft±©g*ft»£i/r©^>^-« 
^T, C©i©^. *^^2 1 ©BtfttfflfflEteo^Ttt. 
»K»a-TS3&s. WSWtctt. *»©«-iJ5«9f«:te(,» 

[0 04 0 ] ^gS5^©^2©X^£Or. *^521 

©*^r6j©ffii#«. n 1 jcin-r ct 5 tcafs^aiiEjg 
K1-,T, ^©-i:^^^^..2>£#©m^©*r6j<ttiiBS 
-Srrs j: 5 &#r*iL Tfefc^. ***xj&s. ais^i* 

-ftfaZ&K^lcWLmZft. BulBUl ©X^tc<fc^^ 

f l . Af r , Ar t , Ar r i^c-S., C4aicJ:D. ^ 
^f©*^7 2 1 ©*^-T-S±T^ffiJ©jBft©ffl^ 
a r , a, . ^^IfiJ©iliftffiH?ra f t , a r » , a 
r i . a, » -CTfrr, ftte, ±fB©ae#£*^7 2 1 
*ISAia«lB, «6#©ft»-«»»*©S§»«:j:») >- h 
©x =? A F&m-P A ->y©«#3&5^ 0 , Sic 
«&i»S*©se»©^b«cJ:-3-cfcWte£fc«>. ^SBic 
«. *n&tc^ori^#*HE«U. ±KittlR*dtfiiia 
ffi©(6]^^^Ki-r^c£(c^^7&^ ±ffi©gj£ffi©#ftj 
£3l»±lS]«©^r6j £ «. C 5 L fcill£«©i5ig©rn 

^»©^t«cfls5*itii©-rn*»s:-rsisiBt?©pi* 
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tt#*¥CC&*Ji:5fcRBLfc©r«. @4£#Ill, 

t, am<D^o^--ftgp9 o' 5 c, L 

ft -out, WM<Dcp£:TJ3<iC{<LW~?2>££t<Ctj:K). 

It, *^2 l**«XJS»){c«iW*#oyfcs6»tt:K 10 

{c2cbu^si59 0' «c?is&*h. nrai*isj^©ia«tt© 

aHfrff?*,. a^fr&£gRKCg*©£ttJ&«lW L t £ 
Ifci t©MiI«»^^ J; ^ less. Wtc 

toS<£-5K:m;i£ieg-e&s„ c©«fc^>{ciiigD{c^s 

[0042] (mmmrnvmsiim aac. js&££b© 
tsg&gft-^-r. a 5 sen 6 tcii^^©*^ 7 

^C F L ». ^t^TJ; ^k«t 9 1 t—ftmm 2 30 

ftfctM h*^>7-9 2&effl#&£f$J&<h&oT*if3. c 
©*S3»(t <fc 0 ^©HWfc: 4>ii:fr&&^r£ffi4tIRi5 

or, ^©^o/c^-^-x^cffi^jA^cO . ^>y'&L9\- 

SftSP) 9 0<b|HjB#K:mWja2SOMM*^DjA£? 
±T^|6]©iBftar «cot»T«*a9 0° *IK#>6 

«to9<r gs^e^njco^F^^rgKtttffi-c 

©fc#>. ^IQfeJKSS'CW. — {RJibT, ±T75"fr©iIi8 
a r 497' . ttft&KDmfta, L £12 5° £ l/fc 

[0 04 3 3 C©i:5«:ft»Ksfi»ii9SWa«{cj:0 g 50 
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©@h&p f t <Dmmm^t. h-c». ssb±{cjs^/c 
«f^©a^w L t ^tucm^-r^mmw, c © 

^©Sil±^{c sm©^Buftgp<&^fc-t±/cJ«^-©Hi^ 
©m^Sr^l/Tl^S,, t©®®-?^ @^©><n*>^*- 
8SP9 0' %S««:LT, e^©ifttf^tfiJ©^ffliJfii^ 
W t r ^^/cg^^T^L' , , 2El^©m^L' 

*sjgL/. feysfflr (micmmTrjk-?) B®©fe& 

^(C2fc&iliI^ft:{c^S*i|!gM^©*CC. ^©iEffi, "T 
ft to 5SW©ffHfcfrGl *'Q*l©S£fi±©«aRJfc(5'*^ £ 
to, C©jEM©.4SfSa^tt, *^-^-±rg^W©^*> 

[0044] (ftuepaES©nfl^v^£) ^c«c, 
ate^©iEffi©^ >x h ^ > h^'^juiaacc^ 

SStorc^o •?■ L/t, Silted c©H®£igs< <t^© 
^-mseiStor^Scfc^ic. Jttf*i^©B>r*£e-r£ 

ft$tort>s„ 

[0045 ] iu»©^rjsw. m i icm-r&mm&w>iti 
h&^tuvi i ©sg»*sBe-r4. *»wtc«ms 

mwmmiLfj ttz&jzsicu-x: MTzmmfz 

Co ^©tt.^P,7cW?rir?77!>^S^r{C<« 
W. Stc^tiliiao«:^(c«^©^*y^c f l 

tci*«5Si^©«#RWfe^rifii©«af*sm3to. 7cf4 

©^©SGO^^to-CC^ft^,, C©<fc5&5gf^Cl&5£ 

t^i, ^-f ^7"u-5«:«-e©*3sa^-rs/cwr§f 
M©iBBa*sf#6toS. c©j£(cnoT. «*«r*y^-c 
JttKL. *©BH«i«?R*£«SlK«Hlor*-*-«:a 

i-rsci*>#^.6to.5A^ ly^T-j^-hmmt-r state 

«atW«:»^to«:t>©-r. *R«-cttc 5 L/fc^SSttS 
e>ftt>. c 5 urff 6toSiffl»«. 04{c^"TJ;^(c. 

iaffi±©2£*©a^w' t t , w L , t>mwg<Dikw 
frt>M,tcmf&<Dmww l t . w t , ©(fij^tc-^gc-rsct 
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C0 046] a hxnht\z>wmn$m, -e©st^£ 
a*iiffi8«:-en-e*x3ai-r*jftig-citji6stiri>*. io 

[0 047] ±iB©A-F©3aHrtS*S?3|B-r^< . « 
2©<gmil^©«»r^^St©ct 3 ^J»^©i#tt. E 

MHbwar***. -€-n6©«tw<jaiKeBSfl»s£ 

[0 048 ] ^(C. ®«l©iS^{CA~D©{5Itl*>©X 

■ct»s. ft*, x-r »?*sa»?3nrai,>*i^'cfe, b 30 

OEP^ttbfcfHfB' . D' tSltl,^. cpff 

awottecct* . f © e^stis©*^^ 6 e <owmn 

[0 049] (JHF-t*&f|0 M«F-eafpCCteWS^^ 

w. „ jfettiHtcaiaKT^o. -e©7-Y>*mMwf^ 40 

IflItCSSUfc7-r> (WJSti^KW) L, l , L 
. , £BM±4Cfi:teTS|^-&C££S#<!:T£„ C© 
**HM^-Y>L. 1 , L B n ©ftb«?(c£^i*© 

ft^[»Kc^t>#5^«ft < , -en6©«^ffl!i*»?) 2 0 

c m <' 6 1 T?©v - Is > ^Jt/ctffc 5 > £ T £ £ £ 
SiJ©^aiUT» 01 OCC^cf J^tX 

+©34ffl«7^>©?S"J$W^L. s , L T s £0© (1) 50 
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X« (2) &C^-rctMt^TS#7£4>#*64-l& 0 C 
tt« 09K^f £Mci|i-©ii;jgL &£CHil 0 cmPiB 

psnK©«i&©^ >iifc<3, f-f+©^#mf 

M£ ^ - i>x # £ J: 5 (tlEfttfj&agiot-r -5.^©^ * 

[0050] -Xicm^n^mt, 02 (c^-r sirs 

WK«fc!)> jWE*6Si||«F1**a»?-rsc4*^fefl:4r 

ft h . KjI*tTB$« c © J: 5 J5rt»*i4-aff ttfefiftr * 

0. H^t»fK^©fc©^atK^©aS^?:^3 

£\ *g#fctt«H»-sw*aBiw--&. c©jiJR«. xr- 

1. T'sA-i'cflssiiSo -zrotRmx&zfrctbmn 

0/cmjSJ^T(Cft^4> ^f5-7'SA-2©fi|ltcJ;"3 

ssk. x--'N--^>*;-x§n^.em©*2t^fflij5-i f 

"P" U>i^sJ<^3 >(cAtin«. ^-ti(cj:^!j<^^ 
a>SW(^-f-;f) 2 30A^*SXff7'SA-l 1 
-C'Wr 5 nr. Xf ^SA-12 t?iW? S W*t«Bft3 

#§F^att^7f -5„ c©w^^«, ffetc. > 

«. h "R" l/>y^> 3 >(ct5i, 

^a>SW 2 3©A*«:J:|,Xf 

S A - 2 ©*IJBIiT\ Xir f7'SA-5{Cj:0ili^p 
r l «:St>0. f^t^iii®<tftS 0 #(c, f^it©»^ 

«. mM©Bu^ftgp^2S&ictitie©r. mi i©^± 
y?&.*i%&<D&m$)r'$,z> 0 ft*?, JiLk©i&Bj§{;^ 

WftSuf^X f7 > y^^fyffiOC ort»S3&*. — SU© 

mciiffl s ^ -5 4 $tx f7 y > ^^©n^cct*. 
•r^©*5w^)-c*?> 0 

[0051] — j; 13 . mmttmte&ntc^ 

m^dt. ^-«±SW©jMW(cJ:«9XT-^^SA- 1 © 

^^F-t± vm&f&i: 5-7SA-3 ©m^j1W»tk: 

)£DtXf'?7'SA- 6X«XT"u;-7'SA-7©ili®^ 

ftort^Bif?:ji3i-rai#^«. m^fU'p&swzm 

tR-?ftl,£. Xf-;7 - SA-K Xr-y 7*S A-8&Ccfc& 
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9xitx7-vy'SA - 1 0 5c<fc<D— mwicm&ftcBkm-r 
Z, c £ &x s* . aigismc£ o fcX^^ff ^ ci^ft 
So si ncfcws&^^-a-Hffi^a, 
iii^%-g|5€BSLriij®?:ffiBS{i:U-r^L/'cfe©-c. n 

[0 052] (K«^[EJig«W) W«^l5lig^©l«^ 
©C£Jot*56. mfjIB#©^SiJ«iiaifL. s F £f£itB#©^- 

$j$m$u s . ^-ciEsiJt-ca^-r-s. c©ti^©^aij 

So C©EM©h§-£, 0 1 3(C?nTJ: *5tc, |Hffi3©g£ 
^* 3 *5. C©J:5£ct§^©/c#>K:. 012(c*rrj: ; 5 

[0053] caym^com^n^mt, hhk^ 

a -tcS£t,\ iS^tHSfP©!©^ |sj D < (gmii 

mtcmmrz. mm.mDW2t l cjjk-?miRsw (f«x«iu 

1©«W-C, X^*?*SB-2iC<£9^I&t-£ftgfS©iIi 
f§* 5) ^r^-rSo ^©Bftcx^T 1 ;^^ 

fifc£j-fe>1>-~2 6©A#*SiC. XfT'J>m m 

^flf-e-c^n-r -s. c ®^7K«. xf •j'/sb-3 ©*U 

£ft&l>t§£(Ui, Xf B- 1 ©ffiBrCB' tcj» 

xf^'sB-5 ©«wrsaa.©jEi»-b >■?•-- 2 
x-f ->7*sb-7(cj;o, s^r-sftwcDaflufe^-r 

-5>4ifeiCXf-^^SB-8(ci;0 »$ ft *£-T £ . 

^(om^(Dm^mm(D— m*m 1 5tt^-r. 
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s©r. -e©ja^«0 1 5 ©HiffiijiKMfecniiy&tfSf 

[0 0 54] (B&ftftQ CCTtiil 6£#MLT. 
tE*»ff T * & it b I > £ t, > fen £ f^iilim©*^ £0H £ 

t-ti&Bj-rs,, c©&ftr?tt, ©©fig-ess i^sii 
JUx^-xsrSgisu ©©s^fPia^figs-CBtrii 

10 <b. <3>©iSgrffl£g#CCt"*rt>£l> 5 C £-?&£,, H 
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